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We report a search for a narrow ti resonance that decays into a lepton+jets final state based on 
an integrated luminosity of 5.3 fb _1 of proton-antiproton collisions at %/s = 1.96 TeV collected by 
the DO Collaboration at the Fermilab Tevatron Collider. We set upper limits on the production 
cross section of such a resonance multiplied by its branching fraction to tt which we compare to 
predictions for a leptophobic topcolor Z' boson. We exclude such a resonance at the 95% confidence 
level for masses below 835 GeV. 

PACS numbers: 14.65.Jk, 13.85. Rm 



Narrow resonances that decay to top-antitop quark (tt) 
pairs are predicted by many models of physics beyond the 
standard model. Such heavy neutral gauge bosons (X) 
appear in grand unified theories with symmetry groups 
larger than SU(5) p], as Kaluza-Klein excitations of the 
gluon or of the Z boson that predominantly decay to ti 
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pairs [3] , as axigluons [3] , and in theories of new strong 
dynamics 5, 6J. Some resonances are expected to have 
a large decay width and would be hard to detect over 
standard model rt-pair production. Here we search for 
a tt resonance with a width that is significantly smaller 
than the detector resolution for reconstructing its mass. 

Searches for ti resonances were previously carried out 
by the DO and CDF collaborations at the Fermilab Teva- 
tron Collider, and no evidence was found for resonant 
production [5] . To extract limits on the mass Mx of a 
resonance, limits on cross sections were compared to pre- 
dictions for a leptophobic topcolor Z' boson with width 
r = 0.0l2Mz> [6]. To simplify comparisons with previous 
limits, we use the same model as a reference. The lower 
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limit for the mass of such a topcolor Z' boson published 
by the DO Collaboration is 700 GeV [7] based on 0.9 ftT 1 . 
The CDF Collaboration excludes Z' boson masses below 
900 GeV [5] using 4.8 fb -1 of integrated luminosity. Both 
limits correspond to 95% confidence level (C.L.). 

We carry out the search using lepton+jets (i'+jets) 
events in which one of the top quarks decays "leptoni- 
cally", t — > Wb — > Ivb, and the other "hadronically" , 
t — > Wb — > qq'b (charge conjugate states are implicitly 
included in our notations). This final state is character- 
ized by an isolated charged lepton (electron or muon), 
imbalance in transverse momentum pr from the unde- 
tected neutrino, and jets from the fragmentation of the 
four quarks. The data correspond to an integrated lu- 
minosity of 5.3 fb -1 and were acquired by the DO exper- 
iment at the Fermilab Tevatron Collider in pp collisions 
at ^/s = 1-96 TeV. 

The DO detector consists of central tracking, calorime- 
ter, and muon systems [9[ [10] . The central tracking sys- 
tem is located inside a 1.9 T superconducting solenoidal 
magnet. Central and forward preshower detectors are 
located just outside the coil and in front of the calorime- 
ters. The liquid- argon/uranium sampling calorimeter is 
divided into a central section covering pseudorapidity 
|ry| < 1.1 and two end calorimeters extending coverage up 
to \r)\ ps 4. The calorimeter is segmented longitudinally 
into electromagnetic, fine hadronic, and coarse hadronic 
sections with increasingly coarser granularity. The muon 
system, located outside the calorimeter, consists of one 
layer of tracking detectors and scintillation trigger coun- 
ters inside a 1.8 T toroidal magnet and two similar layers 
outside the toroids. A three-level trigger system selects 
events that are recorded for offline analysis. 

Events must satisfy one of several trigger conditions, 
all requiring an electron or muon with high transverse 
momentum, in some cases in conjunction with one or 
more jets. The event selection requires one isolated lep- 
ton with pt > 20 GeV, missing transverse momentum 
above 20 GeV (30 GeV) for the e+jets (jU+jets) data, 
and at least three jets with px > 20 GeV. The leading 
jet must have px > 40 GeV. We require at least one jet 
to be tagged as originating from the fragmentation of a 
b quark. Further details about the £+jets event selection 
can be found in [IT] and [T2]. After applying these cri- 
teria, the dominant background is continuum it produc- 
tion. We discriminate between continuum and resonant 
ti production using the invariant mass of the ti system. 
The ^4-jets events are divided into four subsamples de- 
fined by lepton flavor (e, ji) and jet multiplicity (3 jets 
and > 4 jets). 

The two main standard model processes that yield an 
isolated lepton, pr, and several jets are tt and IF+jets 
production. The third most important background arises 
from multijet events in which a jet is misidentified as an 
electron, or a muon from heavy-flavor quark decay ap- 
pears isolated, and pr is mismeasured. Single top quark, 



Z+jets, and diboson production can also give rise to such 
final states, but have much smaller yields. 

We simulate tt, W+jets and Z+jets production using 
the ALPGEN+pythia event generators [TMIB] , Three 
subsamples, W+bb, W+ cc, and W+light-partons, are 
generated separately. Similarly, the Z+jets samples are 
divided into Z+ bb, Z+ cc, and Z+light-parton sam- 
ples. We simulate single top quark production using 
the COMPHEP-SINGLETOP [TBI E] generator and dibo- 
son (WW, WZ, and ZZ) production with pythia. For 
all simulations, we set the top quark mass to m t = 
172.5 GeV and use the CTEQ6L1 parton distribution 
functions [TH] . We simulate detector effects using GEANT- 
3 pjj] and add randomly triggered events to all simulated 
events to account for multiple pp collisions in the same 
bunch crossing. These events are reconstructed using the 
same procedures as for data. 

To estimate backgrounds we use either data-driven 
methods or simulation. We estimate the number and 
distribution of multijet events that are contained in each 
subsample using a control data sample [5U]. We scale ti 
production to the theoretical approximate next-to-next- 
to- leading order (NNLO) prediction of a(pp —> tt) = 
7.48^0 72 pb [21) ■ We normalize single top quark produc- 
tion in the s and t channels to the NNLO cross section 
with next-to-NNLO threshold corrections of 3.3 pb |22) . 
We normalize diboson processes to their next-to-leading 
order (NLO) cross sections, as computed with mcfm |23j . 
of 12.0 pb for WW, 3.7 pb for WZ, and 1.4 pb for ZZ pro- 
duction. We fix the relative normalization of the Z + bb, 
Z + cc, and Z+light parton samples and the relative nor- 
malizations of the W+ bb, W+ cc, and VF+light parton 
samples to NLO predictions computed with MCFM |23j . 
We then normalize the inclusive Z boson production such 
that a(pp -> Z) x B(Z n + n~) agrees with the NNLO 
prediction of 256 pb [24]. We normalize the number of 
W+jets events such that the total number of events pre- 
dicted by all background sources equals the number of 
events observed in each of the four subsamples before 
imposing the 6-tagging requirement. This corresponds to 
increasing the total number of W+jets events expected 
by a factor of approximately 1.3 which is close to the 
NLO k-factor for W^+jets production. 

As a model for tt resonance production, we use pro- 
duction of a Z' boson in pythia, that decays exclusively 
to ti pairs. We consider 18 resonance mass values Mj 
between 350 and 1200 GeV. The intrinsic widths of the 
resonances are set to T x — 0.012Afx- 

We reconstruct the ti invariant mass, m t j, using up to 
four jets with the highest pr, the charged lepton, and 
the neutrino. We determine the momentum of the neu- 
trino by equating the neutrino pt to the measured pr 
constraining the invariant mass of the charged lepton- 
neutrino system to the W boson mass and choosing the 
smaller solution of the resulting quadratic equation for 
the neutrino momentum component p z along the beam 
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FIG. 1: Distributions of m t t for resonances with mass Mx, 
normalized to the predicted aB from Table [ill 

direction. If there is no real solution we set neutrino 
p z = and scale the pr to satisfy the W boson mass 
constraint. Figure [I] shows the expected distribution of 
the reconstructed m t i from the production of narrow ti 
resonances of different mass values. The detector reso- 
lution for m t t varies between 65 GeV for Mx = 400 GeV 
and 270 GeV for Mx — 1.2 TeV, which is much larger 
than the widths of the ti resonances considered. 

We use the reconstructed ti mass to test for the pres- 
ence of a signal in the data and to compute upper lim- 
its on the production cross section of a narrow ti reso- 
nance times branching fraction to ti, aB, as a function 
of its mass. For each hypothesized value of the resonance 
mass, we fit the data to background-only and to sig- 
nal+background hypotheses. For each hypothesis we also 
vary the systematic uncertainties given in Table [T] subject 
to a Gaussian constraint to their prior values to maximize 
the likelihood [25] . We then use the profile likelihood ra- 
tio L = — 2ha(P s _|_b/P(,) as the test statistic, where P s +b 
is the Poisson likelihood to observe the data under the 
signal+background hypothesis and P& is the Poisson like- 
lihood to observe the data under the background-only 
hypothesis. For the background-only hypothesis, we fit 
three components to the data. We constrain the ti pro- 
duction to its theoretical cross section, and the multijets 
background to the predicted number of events. For the 
other backgrounds, we constrain the relative fractions of 
the individual background sources to their predicted val- 
ues and treat the overall normalization as a free param- 
eter. For the signal+background fit we add aB for the 
resonance as a parameter to the fit. 

We use the CL S method [26] to determine the limits on 
aB. Using pseudoexperiments, we determine the prob- 
ability to measure values of L that are larger than the 
value observed in the data sample if there is a ti reso- 
nance signal, CLg+b, and if there is no such signal, CL\>. 



TABLE I: Summary of systematic uncertainties above 2%. 
Some values vary with subsample. The numbers give the 
range of the uncertainties. 



Source 


resonance 


tt 


multijets 


tt cross section 




y /o 




Multijets normalization 






(30-50)% 


Integrated luminosity 


6.1% 


6.1% 




Monte Carlo model 




4.3% 




Trigger efficiency 


<5% 


<5% 




^-tagging efficiency 


(3-11)% 


(3-5)% 




Lepton identification 


(3-4)% 


(3-4)% 




Jet energy calibration 


(2-4)% 


(2-5)% 




Jet energy resolution 


(3-5)% 


(3-5)% 




Jet identification 


<7% 


<10% 





The value of aB for which 1 — CL s+ i,/CLi, = 0.95 is the 
95% C.L. upper limit. We repeat this procedure at every 
resonance mass value. 

Table [I] summarizes the sources of systematic uncer- 
tainties in the normalizations of the components of the 
model used in the limit calculation. No uncertainties are 
given for the physics backgrounds other than ti produc- 
tion because their normalizations are free parameters of 
the fit. When estimating the effect of uncertainties in 
the jet energy scale, the jet identification efficiency, and 
the jet energy resolution, we vary the shape of the m t i 
distributions. We also assign an uncertainty to the shape 
of the m t t distribution from ti production equal to the 
difference between the default simulation using ALPGEN 
and pythia and a simulation using MC@NLO and her- 
wig. We also considered variations in the amount of 
initial and final state radiation but concluded that the 
resulting changes in the m t i distribution were negligible 
relative to the uncertainties that we already consider. 

Figure [2] shows the distribution of m t j observed in data 
compared to expectations from standard model back- 
grounds and a 950 GeV ti resonance. We observe a small 
excess of events at high mass values. The excess is present 
in both the e+jets data and the /x+jets data. We can fit 
the data best with an additional resonance signal with a 
mass of 950 GeV and aB = 0.10 ± 0.05 pb. The value 
of 1 — Cib for the data gives the probability of getting a 
deviation of at least the observed size at this mass value 
from the standard model expectation in the absence of 
physics beyond the standard model. We find a p value 
of 0.018, corresponding to 2.1 Gaussian-equivalent stan- 
dard deviations. This significance value does not take 
into account that the excess may have occurred at any 
place in the mass spectrum. 

Figure [3] and Table [TT] display the resulting limits on 
aB compared to the limits expected in the absence of a 
narrow ti resonance and to the predicted NLO produc- 
tion cross section of a topcolor Z' boson [B] as a function 
of the resonance mass. The expected mass limit for pro- 
duction of such a Z' boson that exclusively decays to 
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FIG. 2: Distribution of m t t for events that pass the final 
event selection with (a) exactly 3 jets and (b) at least 4 jets, 
compared with expectations for standard model processes and 
a 950 GeV resonance signal with the best fitted aB = 0.10 pb. 
The highest bin in each histogram shows the number of events 
with m t f > 1175 GeV. 



tt is 920 GeV. The observed cross section limit excludes 
Z' boson production at the 95% C.L. for masses below 
835 GeV. 

In our previous publication j7j, we computed a 
Bayesian limit on aB for a tt resonance. For reference, 
we have repeated the same calculation using a subset of 
the data sample reported in this paper, corresponding to 
4.3 fb -1 , and find results consistent with the limits on 
aB given in Fig. [3] We also find that our results are in- 
dependent of the couplings of the tt resonance (pure vec- 
tor, pure axial-vector, or standard-model Z-like) and are 
therefore valid for any narrow resonance decaying 100% 
to a tt final state. 

In conclusion, we searched for production of a narrow 
tt resonance in the lepton+jets channel. We do not ob- 
serve a signal consistent with the production of such a 
resonance, although we observe a slight excess of events 
around 950 GeV. We set upper limits on the cross sec- 
tion times branching fraction for production of such a 
resonance for masses between 350 and 1200 GeV. We ex- 
clude at 95% C.L. the production of a topcolor Z' that 
decays exclusively to tt for mass values below 835 GeV. 



TABLE II: Observed and expected 95% C.L. limits on aB 
compared with predictions for a topcolor Z' computed as- 
suming m t = 172.5 GeV and CTEQ6L1 parton distribution 
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expected limit 


observed limit 


(GeV) 
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(Pb) 


(Pb) 


350 


7.85 


1.13 


1.13 


400 


12.79 


1.18 


0.96 


450 


8.59 


0.92 


1.16 


500 


5.35 


0.62 


0.95 


550 


3.32 


0.42 


0.39 


600 


2.03 


0.34 


0.28 
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1.24 


0.26 


0.19 
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0.76 
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0.24 
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0.46 


0.16 
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0.28 
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0.11 
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0.059 


0.07 


0.18 
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0.034 


0.07 
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0.020 


0.06 
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0.012 
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0.0041 


0.07 
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FIG. 3: Observed and expected upper limits on cross section 
times branching fraction aB for a narrow tt resonance as a 
function of the resonance mass. The shaded regions around 
the expected limit represent the ±1 and ±2 standard devi- 
ation bands. The solid line shows the predicted topcolor Z' 
production cross section assuming B(Z' — > tt) = 100%. 
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